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COMPOUND CLASSIFIER FOR PATTERN RECOGNITION APPLICATIONS 



Background of the Invention 

Technical Field 

The invention relates to a pattern recognition device 
or classifier. Image processing systems often contain 
pattern recognition devices (classifiers) . 



Description of the Prior Art 

Pattern recognition methods are particularly important 
in automatic control engineering and in machine text 
processing, for instance, in optical character recognition 
(OCR) readers of automatic letter distribution systems or 
the analysis of forms. For example, the text characters on 
an envelope can be located, parameterized, and classified 
by the system. Such a system may also have the capability 
of sorting the mail based on the results. Therefore there 
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is significant financial incentive for improved 
classification techniques. 

Recognition systems making use of pattern recognition 
devices are known. The key point is that a "feature 
5 vector" is formed to represent whatever is to be 

"classified" or recognized as associated with one of a 
plurality of output classes by the pattern recognition 
device. The system then takes whatever subsequent action 
is implied by the results. In postal processing systems 

10 the subsequent action is typically a revenue computation or 
mail sortation. 

Using the example of a mail-piece indicia recognition 
system, the process begins with the image capture via a 
camera. The image is then preprocessed to locate the 

15 stamp (s), remove any rotation, and down-scale the 

identified section(s) of the image. Feature extraction 
converts each sub-image candidate into a vector of 
numerical measurements. Thus, the feature vector 
represents the image in a compact form. This vector is 

20 classified to produce a stamp ID (output classification, or 
class ID) using a pattern recognition device. Finally, the 



3 



stamp ID is post-processed into the revenue present on the 
mail piece, and the system can use this to tally the total 
revenue processed in a given run (or day) . 

A preprocessing stage operates on the full image to 
5 enhance or change the image representation, and produce 

image segmentation. Image representation enhancement often 
includes binarization and filtering. Image segmentation 
identifies each candidate object within the larger image 
for subsequent recognition analysis. For example, to 

10 recognize the stamps on an envelope, the stamps are located 
and then recognized one at a time. Similarly, the 
characters of the address are recognized one at a time. 

Feature extraction is performed on each candidate 
object to convert it from an image segment to a vector that 

15 represents that image segment. The vector is formed from a 
sequence of measurements performed on the image segment. 
Many feature types exist and are selected based on the 
characteristics of the recognition problem. 

A classifier relates the feature vector to the most 

20 likely output class, and determines a confidence value that 
the actual image is a member of the selected class. 



Typical systems contain a statistical or neural network 
classifier. These techniques convert the feature vector 
input to a recognition result and an associated confidence 
value. The confidence value provides an external ability 
5 to assess the correctness of the classification. For 

example, a classifier may output a value between zero and 
one with one representing maximum certainty. 

Several factors have large effects on the type of 
classifier design selected. One factor is the 

10 'dimensionality' of the device. This is simply related to 
the number of elements in the feature vector, and the 
number of output classes. The number of classes directly 
ties to the application. For text-recognition there is the 
alphabet with uppercase and lowercase characters and some 

15 combinations (1 with 1, etc), typically resulting in fifty- 
six to seventy classes. For stamp recognition there are 
thousands of possible stamps but only a few are popular. 
One stamp-recognition project requires recognition of 160 
stamps. A recent presort-label recognition device required 

20 five classes. 

Another large factor in classifier selection is a 
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trade-off between the performance of their recognition and 
confidence outputs. Techniques that perform extremely well 
at the recognition task, such as Bayesian distance 
measurements and standard backpropagation neural networks, 
5 usually do not produce very meaningful output confidence 
values. Techniques that produce good confidence 
measurements, such as radial basis functions, are often 
challenged to meet the recognition performance or introduce 
too many errors . 

10 Figure 1 shows a general configuration of a 

classifier 1 used by the most common techniques such as 
Bayes, radial basis function (RBF) , and standard 
backpropagation neural networks. In this configuration, a 
discriminant function (e.g. 2A) is associated with each 

15 possible output class. Each discriminant function 2A-2N 
converts a feature vector 3 to a single measurement. A 
decision stage 4 compares the outputs 5A-5N of all of the 
discriminant functions to determine the strongest output 
(e.g. 5B) . The index-number 6 of this strongest output 

20 corresponds to the output class, while the value of this 
output corresponds to the confidence 7 that the 



classification is correct. 

There are many possible forms of discriminant 
functions and the needed training data depends on the 
selected base discriminant function. Within each 
5 discriminant function 2A-2N are parameters that are 

computed prior to runtime operation in a 'training mode'. 
In the training mode, the internal parameters are computed 
from a "training set" of feature vectors. To compute the 
training data, numerous . representative image samples are 

10 needed for each output-class. The image samples are 

converted to vector-samples for training by simulating the 
front end of the system. The training data is simply a set 
of statistics extracted from these sample vectors. 
Prior art systems exist that yield an optimum 

15 classifier, and a somewhat useful confidence measurement. 
However, a computer-based implementation is faced with a 
trade-off. Computing the full equation is processing 
intensive. Reducing the equation requires sacrificing the 
validity of either the classification or the associated 

20 output confidence value. This patent directly addresses 
this trade-off issue. 
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STATEMENT OF THE INVENTION 

In accordance with one aspect of the present 
invention, a method is disclosed for classifying an input 
pattern into an associated class through use of a compound 
5 classifier. Data pertaining to preselected features 
present within the input pattern are extracted. A 
discriminant value for each of a plurality of classes is 
then determined via a first classification technique. This 
value reflects the relative likelihood that a class is the 

10 associated class. The class with the highest relative 

likelihood is selected. A confidence value is generated 
via a second classification technique. This confidence 
value is reflective of the a posteriori probability that 
the selected class is the associated class. The selected 

15 class is rejected if the determined confidence value is 
below a predetermined threshold value. 

In accordance with another aspect of the present 
invention, a computer program product operative in a data 
processing system is disclosed for use in classifying an 

2 0 input pattern into an associated class. The computer 
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program product includes a feature extraction routine for 
extracting data pertaining to preselected features present 
within the input pattern. A recognition portion is also 
present for determining a discriminant value for each of a 
5 plurality of classes via a first classification technique. 
The discriminant value reflects the relative likelihood 
that a class is the associated class. The recognition 
portion selects the class with the highest relative 
probability. 

10 The program further includes a rejection portion for 

generating a confidence value via a second classification 
technique. The confidence value is reflective of the a 
posteriori probability that the selected class is the 
associated class. The rejection portion rejects the 

15 selected class if the determined confidence value is below 
a predetermined threshold value. 

Brief Description of the Drawings 

Fig. 1 is a functional schematic of a prior art 
classifier. 

20 Fig. 2 is a functional schematic of the present 



invention. 

Fig. 3 is a block diagram of a representative system 
in which the present invention has been implemented. 

Fig. 4 is a flow diagram of the run-time operation of 
the present invention. 

Fig. 5 is a flow diagram of the training process in 
the present invention. 

Detailed Description of the Invention 

In accordance with the present invention, a compound 
pattern classification system and method is described. The 
classification method and system may be applied to any 
traditional pattern recognition task, including, for 
example, OCR (optical character recognition) , speech 
translation, and image analysis in medical, military, and 
industrial applications. 

The pattern recognition method set forth by the 
present invention makes it possible to achieve higher 
recognition and rejection performance without significant 
timing impacts when compared with a common one-stage 
technique. This is achieved by a method that preserves the 
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reliability of the classification decisions together with 
the reliability of the output confidence values. To 
achieve this, a compound classifier is formed from two 
classification devices, a recognition classifier and a 
rejection classifier. This compound classifier solves the 
core problem by combining two techniques that are 
specialized at the extremes of recognition and rejection 
performance . 

In particular, this technique was developed for 
proportional character recognition where a preprocessing 
stage often has errors in the segmentation of characters 
within the image. The confidence output from the 
classifier was designed so that the character segmentation 
can be re-tried until the postage address was fully 
recognized. This technique has also proven very valuable 
for postal stamp and indicia recognition. 

A recognition classifier for the compound classifier 
is selected based on its recognition performance. Many of 
the classification techniques that are good at the 
recognition task produce meaningless confidence values. 
The normal problem with this situation is that the validity 



of the confidence value becomes relative rather than 
absolute and thus serves only the purpose of selecting the 
best classification. In this case, a confidence value will 
be separately computed, and the confidence values outputted 
5 from the recognition classifier will be ignored. The use 
of the relative classifier at the recognition stage 
significantly improves the computation requirements for 
run-time operation. 

The internal architecture of a rejection classifier 

10 within the compound classifier differs significantly from 
that of prior art classifiers. Compared with the standard 
classifier architecture, there is no decision stage, and 
only one confidence value is computed. Selection of this 
technique is based on its confidence-measurement 

15 performance with the added requirement that the internal 
processing be partitioned by the output class. This way, 
the rejection classifier's computation time is reduced to a 
small fraction of the total time and becomes insignificant 
to the total classification time. Since the output class 

20 is already selected, there are no classification errors 
interjected by this device. 



Thus, the requirements of this stage include internal 
partitioning so that a confidence value for a single class 
may be calculated independently and efficiently. The 
validity of the confidence value takes priority over the 
5 recognition performance that is disabled in this 
configuration. 

It is assumed the classifier will be placed in an 
existing hardware application. In an example 
implementation of the classifier in a mail sorting system, 

10 mail is scanned as it passes the camera on a conveyor. 

Computers are networked to move the image into a node of a 
processing array. The computed results are returned to the 
conveyor hardware that diverts the mail according to the 
recognition result. If it's a stamp-recognition device, it 

15 may simply tally the revenue processed rather than 
diverting the mail. The recognition solution would 
typically contain the compound classifier software as well 
as feature extraction software, some preprocessing software 
and probably some post-processing software as well. 

20 Fig. 2 illustrates the internal architecture of the 

compound classifier 10. The classifier 10 receives a 
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feature vector 12, which is processed by each of the two 
stages of the classifier 10. Initially, a recognition 
stage 14 of the classifier relates the inputted feature 
vector 12 to the most likely output class based upon 
5 existing training data. The recognition stage 14 utilizes 
a classification technique that is efficient in classifying 
individual inputs but cannot produce a useful confidence 
value. Once a class is chosen, the selected class is 
inputted to a rejection stage 16. The rejection stage 16 
10 computes a confidence value based on the a posteriori 

probability that the inputted feature vector 12 is a member 
of the selected class. The decision of the recognition 
stage 14 is accepted or rejected based upon this confidence 
value . 

15 An application of this process in the context of a 

mail sorting system is shown in Fig. 3. A mail system 100 
is capable of accepting an envelope, locating any stamp 
thereon, and extracting the features from the stamp images. 
The claimed process is used in determining what types 

20 and/or values of stamps are present on the envelope. The 
system could check the mail for adequate postage or keep a 
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running total of the postage value of a set of mail. As an 
alternate embodiment, text characters on the envelope can 
be located, parameterized, and classified by the system in 
accordance with the present invention. Once the zip code 
or city of destination has been determined, a system could 
sort the mail based on destination. 

Focusing on the stamp recognition system illustrated 
in Fig. 3, the system 100 first produces a scanned 
image 102 of an input envelope. The scanned image 102 is 
input to a preprocessing stage 104, which filters the image 
and locates any stamps within the envelope image. The 
image is segmented to isolate the stamps into separate 
images and extraneous portions of the stamp images are 
cropped. Finally, any rotation of the stamp is corrected. 

The pre-processed image progresses to a feature 
extraction stage 106, which generates data from selected 
features within the image. The selected features can be 
literally any quantifiable features discernible from the 
scan of the image that vary sufficiently among the various 
classes of images to serve as a basis for discriminating 
between them. Typically, these features will be selected 
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prior to any training or application of the classifier. 
For the purposes of computation, the feature data can be 
treated as a feature vector 112. For ease of reference, 
the features reflected in the individual feature vector 
elements will be described as feature variables throughout. 
In the disclosed embodiment, a thirty-two element feature 
vector 112 is used, consisting of sixteen histogram feature 
variables, and sixteen "Scaled 16" feature variables. 

The histogram portion of the feature vector 112 
focuses on the grayscale value of the individual pixels. 
Each of the sixteen histogram feature variables represents 
a range of grayscale values. The values of the feature 
variables are derived from a count of the number of pixels 
in the image with a grayscale value within each range. By 
way of example, the first histogram feature variable might 
represent the number of pixels falling within the lightest 
sixteenth of the grayscale range. The feature variable 
values are normalized to a zero-to-one scale to facilitate 
later processing. 

The "Scaled 16" variables represent average grayscale 
values of the pixels within sixteen preselected areas of 



the image. By way of example, the sixteen areas may be 
defined by a 4x4 equally spaced grid superimposed across 
the image. Thus, the first variable may represent the 
average or summed value of the pixels within the upper left 
5 region of the grid. Again, these feature variables are 
normalized to a zero-to-one scale for computational 
purposes . 

Once the feature vector 112 has been extracted, it is 
inputted to a classification stage 110. Although in the 
10 preferred embodiment, the classification stage 110 is 

implemented as a portion of a single computer program, it 
is best conceptualized as two distinct stages or steps, a 
recognition stage 114 and a rejection stage 116. 

The recognition stage 114 of the process relates the 
15 inputted feature vector to the output class to which it is 
most likely to belong based upon the known training data. 
Typically, this is the result of an optimization procedure, 
where the feature vector of the input is compared to ideal 
feature vectors of each of the classes to determine the 
20 closest fit. 

In the illustrated example, each class has an 
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associated discriminant function 118A-118N, which receives 
the extracted feature vector 112. Typically, within a 
particular classifier, each discriminant 118A-118N function 
will have the same basic form, varying from the others only 
5 as to certain parameters determined in training. Each 
discriminant function 118A-118N outputs a scalar 
discriminant value 120A-120N representative of the amount 
of deviation between its associated class parameters and 
the input vector 118. Accordingly, the class associated 
10 with the minimum discriminant value (e.g. 120B) will be 
selected by the system at a selection stage 122. The 
discriminant functions 118A-118N and the selection criteria 
will vary, however, with the classification technigue used 
at this stage. 

15 Within each discriminant function 118A-118N are 

parameters, such as the above mentioned ideal class vector, 
that are computed prior to runtime operation. In a 
training mode, the internal parameters are computed from a 
training set of feature vectors that are derived from 

20 sample images for each class. There are a number of 
acceptable classification techniques and the needed 



training data depends on the associated base discriminant 
function of the chosen technique, the number of output 
classes, and the selected features. Accordingly, the time 
and sample size necessary for training varies widely and 
5 often influences the selection of a classification 
technique. 

In accordance with the present invention, the 
classification technique utilized for the recognition stage 
114 will be selected to maximize recognition accuracy at 

10 the expense of accuracy in producing a confidence value. 
Specifically, the recognition stage 114 will either make 
use of a classification technique with strong recognition 
capabilities but limited ability to generate useful 
confidence values or a known technique will be modified to 

15 produce a discriminant value (e.g. 120A) meaningful only 

relative to the other discriminant values (e.g. 120B-120N) . 
Regardless of the method used, the result is a relative 
discriminant value (e.g. 12 OA) , which retains meaning for 
comparison within the classes, but cannot be used to 

20 produce an useful absolute confidence value. By way of 
example, a set of relative discriminant functions can be 
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produced by modifying a known classification technique to 
exclude all common-mode terms among its discriminant 
functions (i.e. eliminating all terms that do not vary 
among the classes) . It should be noted, however, that the 
5 term "relative, " is also intended here to apply to 

functions from known techniques that do not produce a 
useful confidence value. 

In the disclosed embodiment, a modified Mahalanobis 
distance classifier is used at the recognition stage 114. 
10 In a prior art Mahalanobis distance classifier, the base 
discriminant function is: 

D± = (x - ■u i )K i " 1 (x - Hi) 1 , where [Equation (1)] 

Di = the discriminant function of one output class i 
(square of the Mahalanobis distance) 

15 

x = the input feature vector, representative of the 
image to be classified 

u ± = an ideal class vector, where each element is equal 
20 to the mean of the corresponding feature variable across 
the sample input feature vectors for class i (i.e. each 
element is equal to the expected value of the corresponding 
element of x, E(x n ) across the vectors in class i) 

25 Ki 1 = the inverse of a covariance matrix derived from 

the sample feature vectors of class i, used to correct for 
interrelations among the various feature 



Often, the covariance matrix Ki for a particular class 



will possess singularities. A singular matrix does not 
have a calculable inverse. To avoid such cases, a generic 
K" 1 may be used where K is a weighted average of the 
covariance matrix of each class with weights based on the a 
5 priori probability of a random input vector falling within 
each class. Using this value for the covariance matrix, 
the base discriminant function from equation (1) may be 
expressed as: 

Di = (x - Ui)K _1 (x - Ui) T [Equation (2)] 

10 Additionally, the Moore-Penrose psuedoinverse can be used 

to solve the inversion problem caused by singularities 

within a covariance matrix. 

In this form, a Mahalanobis distance measurement 

yields the optimum Bayesian classifier and a useful 

15 confidence measurement. The confidence measurement can be 

obtained as follows: 

Confidence = max ( 1-Di/D imax ) , where [Equation (3)] 

Dimax = The maximum value expected for Di, obtained from 
the sum of the maximum values expected for each element of 
20 |x - u| 

While it is possible to obtain useful confidence 
values in this manner, computing the full Mahalanobis 
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discriminant function for each class is processing 
intensive. A considerable amount of processing time can be 
saved by reducing the equation, but any reduction requires 
sacrificing either the validity of the classification or 
5 the accuracy of the associated output confidence value. 

In accordance with the present invention, for the 
purposes of making the initial classification, the 
classifier will not attempt to produce a useful confidence 
value at the recognition stage 114. Consequently, the 

10 discriminant functions 118A-118N for the recognition stage 
114 can be simplified and the necessary computation time 
can be sharply reduced. 

In the case of the Mahalanobis distance classifier 
described above, the discriminant functions 118A-118N can 

15 be reduced by eliminating their common mode terms. Note 
that a covariance matrix and its inverse are symmetric 
square matrices. The base discriminant function from 
equation (2) may therefore be written as: 

D ± = xK'V -2uiirV + UilTSii 1 [Equation (4)] 

20 The first term above is a common mode term; it is 

constant for a given input vector. In accordance with the 



present invention, this term need not be calculated. The 
third term does not vary according to the input feature 
vector x. Consequently, it may be computed and stored 
during the training stage as a scalar value for each class. 
5 In the second term, the quantity -2uiK _1 , which ordinarily 
requires a computationally intensive matrix multiplication 
can be precalculated and stored as a vector for each class 
during training. Accordingly, the run time calculation of 
discriminant function reduces to the matrix multiplication 

10 of two vectors for each class. In fact, the entire 

recognition stage can be conceived as a single matrix 
multiplication of an matrix representing the training data 
for every class by the transposed feature vector. While 
the Mahalanobis distance classifier is only one of several 

15 techniques with which the present invention can be 

implemented, it provides an example of the processing time 
that can be saved at the recognition stage 14 using the 
claimed process. 

Once the class with the minimum associated 

20 discriminant value (e.g. 120B) has been selected, it is 
input 124 to the rejection stage 116. In the rejection 



stage 116, it is necessary to use a classification 
technique that produces a meaningful confidence value. In 
the illustrated embodiment, the rejection stage will, like 
the recognition stage above, have N discriminant functions 
5 126A-126N, each corresponding to one of the N classes. As 
described above, however, a confidence value will be 
computed only for the selected class. Thus, in order to 
realize a savings of computation time, the classification 
technique selected for the rejection stage 116 must meet 

10 the added requirement that its processing be partitioned by 
the output class (i.e. computing a confidence value for one 
class does not require computing confidence values for 
every class) . Since only one confidence value is needed, 
computation time can be saved by using a technique that 

15 computes useful confidence values, even if it would be too 
inefficient for use for all of the class computations. As 
an example, suitable discriminant formulas can be adapted 
from techniques based on radial basis functions. 
Continuing with the illustrated example, a 

20 discriminant value 128 suited to producing a useful 

confidence value can be obtained via the following formula: 
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m r 



X j — U ij 



where, [Equation (5)] 

C ij 

V J i = the class selected by the 



5 recognition stage 

Xj = the j th element of input feature vector x 

Uij = the j th element of the ideal feature vector from 
10 class i. 

CFij = the standard deviation of the feature variable 
corresponding to the j th element of the feature vector 
across the sample feature vectors in class i. 

15 

The discriminant value 128 is easily transformed into 

a classification confidence value similar to a probability: 

Confidence = (1 - Di/D^) , where [Equation (6)] 

Dimax = The maximum value expected for D±, obtained from 
20 the sum of the maximum values expected for each element of 
Ix - u| 

The maximum value for the confidence discriminant 
value 128 is often more useful when the maximum value of 

25 each error term (i.e. |Xj - u i3 |/o) is limited by non-linear 
clipping. A clipping value may be determined by 
experimentation or related to a statistical value (i.e. . 
clipping value = a number * the standard deviation of the 
feature variable) . For the purposes of the example 

30 embodiment, it has been determined that a clipping value of 
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seven for the error term, | Xj - u ±3 1 /c, works well. When a 
clipping value is used, D imax simply becomes the sum of the 
clipping values of the feature variables. 

The confidence discriminant value 128 is passed to a 
5 decision portion 134 of the rejection stage 116, where the 
confidence value is calculated and compared to a threshold. 
Where the threshold is not met, the classification value is 
rejected. In the stamp classification above, rejected 
images often result from errors in the image segmentation 
10 process described above. Consequently, rejected images 
result in a signal 136 to the preprocessing stage of the 
system 102 to reprocess the envelope with different image 
segmentation. 

Where the confidence exceeds the threshold, the 
15 classification result 138 is sent to the final stage in the 
stamp recognition system, the post-processing stage 140. 
The post-processing stage is simply the application of the 
information gained in the classification stage 110 to a 
real world problem. In the example embodiment, the data is 
20 used simply to maintain a total of the incoming postage. 
Other tasks for the post-processing portion should be 
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apparent to one skilled in the art. 

The run-time operation 200 of the classifier 10 is 
illustrated in Fig. 4. The program commences at step 202 
and proceeds to step 204. In step 204, the process reads 
5 the stored training data for each class. The program then 
proceeds to step 206, where it waits for the input of a 
feature vector 12. So long as the program does not detect 
the input of a feature vector 12, the program remains at 
step 206. Upon receipt of the feature vector 12, however, 

10 the program proceeds to step 208. 

In step 208, the program computes a discriminant value 
for each class, reflective of the relative likelihood that 
a class is the class associated with the input pattern. 
The program then advances to step 210, where the most 

15 likely class is selected. The program then proceeds to 

step 212. In step 212, the program computes a confidence 
value for the selected class, reflecting the a posteriori 
probability that the selected class is the class associated 
with the input pattern. The program then advances to 

20 step 214. 
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In step 214, the program determines whether the 
computed confidence value from step 212 exceeds a 
predetermined threshold. If the threshold is exceeded, the 
program advances to step 216, where the classification is 
5 accepted. The program then returns to step 206 to await 
the input of another pattern. If the confidence threshold 
in step 214 is not exceeded, the program proceeds to 
step 218, where the classification result is rejected. The 
program then returns to step 206 to await another input 
10 pattern. 

Fig. 5 shows a flow-chart illustrating the operation 
of a computer program 250 used to train- the compound 
classifier device via computer software. Prior to 
training, the trainer gathers a sufficient number of sample 

15 images 252 and categorizes them (via human judgement) . The 
number of training images is variable. The number of 
output classes, selected features, and classifier types 
directly affect the number of samples needed for good 
results. Depending on the device, too many samples can be 

20 problematic, as it can take too long to process the 

training data without a significant gain in performance. 
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The actual training process begins at step 254 and 
proceeds to step 256. At step 256, the program retrieves a 
sample image from memory. The process then proceeds to 
step 258, where the images are converted into the feature 
5 vector inputs that the classifier would see if it were in a 
normal run-time operational mode. After each sample 
feature vector is extracted, the results are stored, and 
the process returns to step 256. After all of the samples 
are analyzed, the process proceeds to step 2 60, where the 

10 feature vectors are saved as a set. 

The actual computation of the training data begins in 
step 2 62, where the saved feature vector set is loaded into 
memory. After retrieving the feature vector set, the 
process progresses to step 264. At step 264, the program 

15 calculates statistics, such as the mean and standard 
deviation of the feature variables for each class. 
Intervariable statistics are also calculated, including the 
covariance matrix of the sample set for each class. The 
process then progresses to step 266 where it uses the set 

2 0 of feature vectors to compute the training data. At this 
step, an inverse covariance matrix would be calculated, as 



29 



well as various fixed value terms for the recognition 
classification. After these calculations are performed, 
the process proceeds to step 268 where the training 
parameters are stored in memory and the training process 
5 ends . 

This process produces the internal parameters needed 
by the classifier stage. Usually training would occur 
prior to sale to a customer. However, one system currently 
in development will actually require customer re-training 

10 (for maintaining the stamps in circulation to be 

recognized) . In applications such as text-character 
recognition, the classes are permanently fixed and customer 
retraining isn't necessary. 

It will be understood that the above description of 

15 the present invention is susceptible to various 

modifications, changes and adaptations, and the same are 
intended to be comprehended within the meaning and range of 
equivalents of the appended claims. In particular, it is 
expected that the classification techniques used in the two 

20 stages may be varied without deviating from the intentions 
and principles of this invention. 



